Locally Affine and Planar Deformable Surface Reconstruction from Video
نویسندگان
چکیده
We present new solutions to tackle the problem of reconstructing a deforming surface viewed in monocular videos without a template, by exploiting the fact that many deforming surfaces are on the local scale approximately rigid and planar. The reconstruction task can then be seen, from bottom up as first multi-plane based pose estimation then dense surface reconstruction from planar samples. In practice there are major obstacles to overcome. In this paper we specifically target computing stable orientation estimates at small surface regions from interview image motion. We achieve this using local affine projection models which are stable and accurate when local perspective effects are small. Our core theoretical contributions are closed form solutions to multiview orthographic planar pose estimation in both the minimal and overdetermined cases. We use this to efficiently construct a weak deformable template; an undirected graph with nodes holding the surface’s local planar structure and edges denoting physical deformation constraints. The template can then be used to recover dense 3D shape very efficiently from affine image motion via unambiguous planar pose estimation combined with surface regularisation.
منابع مشابه
Quantitative Endoscopy: Uncertainty Analysis of Motion Estimation with Robust Feature Matching
Feature matching based 3D reconstruction is a standard technique in 3D Computer Vision. An natural extension is to reconstruct dynamic surfaces from videos, such as reconstructing sinus surfaces from endoscopic videos. However, since the camera is moving and the sinus surfaces are normally deformable and non-planar, the feature matching is usually unsatisfactory. We will employ a state-of-the-a...
متن کاملRealization of locally extended affine Lie algebras of type $A_1$
Locally extended affine Lie algebras were introduced by Morita and Yoshii in [J. Algebra 301(1) (2006), 59-81] as a natural generalization of extended affine Lie algebras. After that, various generalizations of these Lie algebras have been investigated by others. It is known that a locally extended affine Lie algebra can be recovered from its centerless core, i.e., the ideal generated by weight...
متن کاملA New Approach for Quantitative Evaluation of Reconstruction Algorithms in SPECT
ABTRACT Background: In nuclear medicine, phantoms are mainly used to evaluate the overall performance of the imaging systems and practically there is no phantom exclusively designed for the evaluation of the software performance. In this study the Hoffman brain phantom was used for quantitative evaluation of reconstruction techniques. The phantom is modified to acquire t...
متن کاملA subdivision-based deformable model for surface reconstruction of unknown topology
This paper presents a surface reconstruction algorithm that can recover correct shape geometry as well as its unknown topology from both volumetric images and unorganized point clouds. The algorithm starts from a simple seed model (of genus zero) that can be arbitrarily initiated within any datasets. The deformable behavior of the model is governed by a locally defined objective function associ...
متن کامل3D Reconstruction of Planar Surface Patches: A Direct Solution
We propose a novel solution for reconstructing planar surface patches. The theoretical foundation relies on variational calculus, which yields a closed form solution for the normal and distance of a 3D planar surface patch, when an affine transformation is known between the corresponding image region pairs. Although we apply the proposed method to projective cameras, the theoretical derivation ...
متن کامل